Databricks

Visier can retrieve data through this connector if the following requirements are met.

Note: Beta This is a beta connector. If you are interested in using this connector, please contact your Customer/Partner Success Manager.

Prerequisites

  • Set up Delta Sharing in Databricks
    • AWS: If your data is stored in an S3 bucket, provide the bucket name and grant read-only access so Visier can access the data.
    • Azure: If your data is stored in a blobstore, provide the blobstore URL so Visier can allow data access through the firewall.

Set up Delta Sharing

Create a share in Databricks so that Visier can retrieve your source data.

  1. In Databricks, go to the Delta Sharing page.
  2. Click Share data in the Shared by me tab.
  3. In the Share data dialog:
    1. Enter a name for the share. This name will appear in Visier.
    2. Add data assets by selecting the tables to share. The selected tables will be loaded into Visier.

      Note: Notebooks cannot be loaded into Visier.

    3. Create a new recipient for Visier with the following settings:
      • Recipient type: Open
      • How will the recipient be authenticated: Token
    4. Click Create.

      Result: An activation link is created. Go to the activation link and download the credential file as you will need to provide the credentials in Visier.

Connector credentials

Create a connector credential in Visier to authenticate and authorize access to your source system. Connector credentials can be created in Studio or through an API. For more information, see Set Up Data Connectors and "Create a connector credential" in API Reference. You will need to provide the following credentials in your connector credential configuration.

The generated file contains your credentials in JSON format. Upload the file to automatically populate the connector credentials, or open it in a text editor to manually enter the required information.

Copy
Credential file example
{
    "bearerToken": "test_token",
    "endpoint": "https://oregon.cloud.databricks.com/api/2.0/delta-sharing/.../",
    "expirationTime": "2025-05-29T22:00:00.000Z",
    "shareCredentialsVersion": 1
}

Credential

Description

Example

Share Credentials Version

The version of the credential file format used by Databricks in the open Delta Sharing protocol.

1

Bearer Token

The token used to authorize the recipient.

test_token

Endpoint

The endpoint for the share to be used by the recipient.

https://oregon.cloud.databricks.com/api/2.0/delta-sharing/.../

Expiration Time (Optional)

The date and time when the authentication token expires in ISO 8601 format.

2025-05-29T22:00:00.000Z

Select the source type

When creating a connector credential, set the source type to define how the connector processes data.

  • File source: Data is stored in files. Updating data requires reprocessing and overwriting entire files.
  • Table source: Data is stored as tables. Incremental updates are supported, allowing you to modify individual records as needed.

Note:  

  • To enable the Table Source option, contact Visier Technical Support.
  • You cannot change the source type after the credential is created. You must create a new connector credential to change the source type.

Sync data

After the connector credential is created, you can configure the connector to bring data into Visier.For more information, see Sync Databricks Data.